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ABSTRACT 

A method for estimating the parameters of the Rasch 
model is examined. The unknown quantities in this method are the item 
parameters and the distribution function of the latent trait over the 
population. In this sense, the method is equivalent to marginal 
maximum ' likelihood estimation. The new procedure is based on a method 
suggested by J. Kiefer and J. Wolfowitz (1956). Their conclusions are 
reviewed, and links to the Rasch model are specified. In marginal 
maximum likelihood estimation, the item parameters are estimated 
first, and then the prior distribution of the person parameters is 
estimated using these estimates. The proposed method illustrates that 
it is possible to estimate these two quantities together and arrive 
at consistent estimates. Two data tables are provided. (SLD) 
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Ads tract 

Various maximum likelihood estimation procedures in the Rasch 
model are reviewed. It is shown that semi parametric estimation 
allows simultaneous estimation of the item parameters and the 
distribution function of ability. Moreover, both the Item 
parameters and the distribution function of ability are estimated 
consistently. 

i 

Key words: Rasch model, Incidental Parameters, Structural 
Parameters. 
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Semi parametric Estimation In the Rasch Model 

In the framework of latent trait theory, the Rasch (1960) model 
has become increasingly popular over the past decade. This is not 
only aue to its wide applicability (flscner, 1977; Lord, 1983), out 
also to the fact that statistically nice procedures for estimating 
its parameters have been developed. 

The purpose of this caper is to examine yet another method for 
estimating the parameters of the Rasch model. In contrast with 
other methods, the unknown quantities in this method are the item 
parameters and the distribution function of the latent trait over 
the population. In this sense, tfte method is equivalent to marginal 
maximum likelihood estimation where the prior distribution function 
(of the latent trait in the population) is completely unspecified 
and has to be estimated from the data. 

As an introduction, in the second section, we will shortly 
review the different maximum likelihood estimation procedures that 
have previously been used, with the Rasch model. These procedures 
are unconditional maximum likelihood (UML), conditional maximum 
likelihood (CML) and marginal maximum likelihood (MML). In 
addition, the new estimation procedure developed 1n this paper is 
introduced. 

The new estimation procedure is based on a method suggested by 
Kiefer and Wolfowitz (1956). In the paper, they show that if the 
number of parameters increases with the number of observations, 
then UML estimation does not always yield consistent estimates for 
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a11 parameters. Two kinds of parameters are distinguished, 
structural and incidental parameters* A parameter that appears in 
a11 the distribution functions will be called structural, while all 
others are called incidental. Within this context Kieier and 
WolfowiU show that, under fairly general conditions, one is aDle 
to consistently estimate the structural parameter and the distribu- 
tion function of the incidental parameters simultaneously. The 
essence of their paper, and some links to the Rasch model will be 
given in the third section. 

The fourth section serves to check Kiefer and Wolfowitz' condi- 
tions in the specific case of the Rasch model. 

Finally, a discussion and an example will be given in the last 
section. 



Maximum Likelihood Estimation in the Rasch Model 



We assume that a group of V examinees are administered k dichot- 
omously scored items and that all items measure the same uni dimen- 
sional (latent) trait or ability. 

In the Rasch model, the item response function, *.e., the proba- 
bility that examinee v answers item i correctly, takes a simple form: 



exp(e y -o i ) 



(1) P(X u4 «l|e Mi o 4 ) = 



vi v> 1 1 + exp(e v -o.) 

where 8 y is the person's ability parameter and is the item 
difficulty parameter. On the usual conditional independence 
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assumptions, the probability that person v's response pattern is 
K 8 \ k ) 1s 9iven by 



(2) P(x v =x y le v ,a) = n 



i 1 + expU^) 



where x y j = 1 if item i is answered correctly and x y ^ = 0 
otherwise, and c = (a^,...,^). Hence, the joint probability 
distribution of the response vectors for all examinees is given by 



(3) 



p(x 1 =x 1 ,...,x v ^x y le A ,...,e v ,a) = n n 



exp{x v .(e v -a 1 )} 



v i 1 + exp(e v -a.) 



If both item and person-parameters are unknown, then the objective 
is to estimate both sets of parameters. Some standard methods of 
estimation will be briefly reviewed; recall that we are dealing 
with maximum likelihood estimation only* 

The first method is unconditional maximum likelihood estimation 
(UML), where all the parameters are estimated simultaneously, by 
maximizing the joint likelihood function (3) over all parameters. 
But this leads to inconsistent item parameter estimates, as was 
shown by Andersen (1973). This is the link to Kiefer and Wolfowitz 
(1956), since in the Rasch model we are dealing with structural 
(item) and incidental (person) parameters. 

The second method is conditional maximum likelihood estimation 
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(CML). In this method, one uses the fact that the total score for 
person v, i.e., the total number of correct responses, is a 
sufficient statistic for that person's ability. Therefore, one can 
condition the likelihood function on the sufficient statistics so 
that the (incidental) person parameters are no longer part of it. 
Hence, the likelihood is now a function of the item parameters 
only, which can be estimated consistently by maximum likelihood. 
Using these estimates, the person parameters can now be estimated. 

The third method is marginal maximum likelihood estimation 
(MML). In this method, a prior distribution for the person para- 
meters is specified and the (incidental) person parameters are 
Integrated out of the likelihood function, so that again one is 
able to estimate the item parameters. The specification of the 
prior distribution can be done in several ways; usually one assumes 
a special parametric form for the prior distribution, say f(x|a), 
and the parameter vector a is estimated along with the Item para- 
meters. 

The new estimation method is based on MML, the only difference 
being that no assumptions on the prior distributions are made. 
Hence, this method can be called semiparametric marginal maximum 
likelihood estimation (Wellner, 1985). 

Structural and Incidental Parameters 

The notion of Incidental and structural parameters was intro- 
duced rigorously by Neyman and Scott (1948). Suppose that we nave 
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independent random variables X^j (j=l k, i*l 9 2 9 ...) 9 such that 

X^ l9 ... 9 X^ (i-1,2,...) are identically distributed witn a distri- 
bution function of the form f(x|o,e^), where c and e i are possibly 
vector valued. Then Neyman and Scott (1948) called the parameter 
c, upon which all the distributions depend, structural , whereas the 
parameters {e^} are called incidental . They showed that the maximum 
likelihood estimator of a, 1n the presence of the incidental para- 
meters {e^}, need not be consistent. They also gave the following 
nice and easy example: 

Example : Let X^j, i=l,...,n, j=l , — ,k be independent random 

variables such that X^ 9 ...,X^ are normally distributed wlth^ 
o 

mean n- and variance c (i=l,...,n). Now consider the problem of 

2 

estimating c las n * «). The maximum likelihood estimates of the 
parameters are then given by 

\i. = I x../k = x. , for i = 1, — ,n- 
1 j 1J K 

° 2 = II (x ir x, ) 2 /nk = S 2 . 
i j 

However, it is well known that E(S*") = ka /(k-1), and hence the 

2 . 

maximum likelihood estimate of c is not consistent. 

This problem was Investigated, among others, by Klefer and 
Wolfowitz (1956) [henceforth denoted as KW (1956)] and Andersen 
(1973). Note that there is an intuitive explanation for the above 
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phenomenon; with each new group of observations we get additional 
Information about the structural parameter, but we also Introduce a 
new Incidental parameter and thereuy more 'bias'. 

Now KW (1956) proved that the maximum livelihood estimator of 
the structural parameter 1s (strongly) consistent, when the 
(infinitely many) incidental parameters are 11d with a common 
distribution function. Furthermore, this distribution can also be 
estimated consistently. Tne following is a heuristic explanation 
for their results: "a sequence of chance variables is more 
'regular* than an arbitrary sequence". 

A different route was followed by Andersen (1973), who solved 
the problem by using and developing the Neyman and Scott method of 
conditional Inference. In this set up, one needs to have sufficient 
statistics for the Incidental parameters to be able to estimate the 
structural parameter consistently. 

It is the purpose of this paper to explore KW (1956) ideas and 
use their method 1n one specific case: the Rasch model. Note that 
all maximum likelihood estimation methods mentioned in the second 
section fit into KW's (1956) framework; in the Rasch model one has 
structural and incidental parameters which can be estimated simul- 
taneously (UML), after conditioning on a sufficient statistic 
(CML), or marginally (MML). 

To proof consistency, KW (1956) need the fulfillment of several 
assumptions. Since their proof is of the Wald-type (i.e., no 
differentiability assumptions for the underlying density function 
are assumed), their assumptions and proof are essentially a 
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modification of Wala's (1949) proof of the consistency in the 
ordinary case (only a finite number of parameters). 

Let us review Kiefer and Wolfowitz assumptions briefly. Note 
that the parameters in KW (1956) are the structural parameter (a) 
and the common prior distribution of the incidental parameters 
P(e). KW (1956) consider the densities 

(4) T(x.io,P) = / fUjIo.G) dP(G); i = 1,2,... 

» 

Now suppose that Q is a set of priors P such that the true prior Pq 
is in Q; the true structural parameter is denoted by <jq. Next, KW 
(1956) define a maximum likelihood estimator for (<Jq»Pq) as a pair 
(o n , ,P n l ) such that 



for all c and all P. It is KW's (1956) main intention to give con- 
ditions such that a n ' + Oq and P 1 P y . In doing so, an important 
role is played by the identifi ability assumption: 
If (a. ,P. ) * (a ? ,P 9 ) then there is a value y for which 



If these conditions are fulfilled, then KW (1956) are able to proof 
the consistency of the ML estimates. 

There is a problem with the size of the set of priors Q; if Q is 



(5) 



n fUjIo^.P^) > n fUjlc.P) 



(6) 
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too large, the identif lability assumption may not be fullfilled or 
no prior P n may De found such that (5) Is true, and if Q is too 
small, the true prior Pq need not be an element of Q. Therefore, 
additional conditions on the set of priors 0 are needed. 

Checking the KW-assumptions in the Rasch Model 

In the Rasch model, we consider o s (a^,...,^) (the item 
parameter) as the 'structural* parameter, whereas 8 y (the person 
parameters, v=l,2,...) are the incidental parameters. Note that the 
number of items is usually fixed and small, and the number of 
examinees is large ; wfth eacn new examinee we also introduce a 
new, unknown person irameter. 

Furthermore, in the Rasch model, the vector of item parameters 
is multidimensional, while in KW (1956) paper the structural 
parameter is unidimensional . This is no serious problem however. 

Note that the Rasch model itself is unidentifiable; acting the 
same number to both all item and the person-parameters does not 
change the probability in (3). Therefore, a constraint has to oe 
imposed on the parameters. A common one is £ =0. For our 
purposes, as will become clear later on, it is easy to take the 
constraint = 0. 

Assumption 1: f(x|o f 9 v ) is a density with respect to a Sigma 

finite measure n on a Euclidean space of which x is 
a generic point. 
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Now, if we take X = N k , A(X) « (2 N ) k the sigma field of all sud- 
sets of N k , and \i as the product of the k counting measures on 
(N,2 N ), this assumption can be shown to be fulfilled for the Rasch 
model. Let Y 1 be Bin (l,exp(e v -o i )/(l+exp(e y -o 1 )) ) and X be n Y i 
distributed. Then X generates a probability measure P on (X,A(X)) 
with dP/dn = f and 



(7) 



f(x y ) = 



exp{x vi (e v -o.)} 

n 

i 1 + exp(e v -o i ) 



if x yi =0 or 1 



(1=1 k) 

otherwi se 



This shows the validity of assumption 1. 

In order to proof the validity of assumption 2, some additional 
definitions are needed. Note that R k is the space of values that o 
can take and that R is the space of possible values of e. Denote 
the set of all cumulative distribution functions G with finite 
second moment by Q. Later on, it will become clear that more 
assumptions on Q are needed, but for the time being this definition 
will do. Let o Q and G 0 be the true value of the parameter o and the 
true distribution function of e respectively. Assume that (o q ,Gq) 
1s In (R k ,Q) and denote this true parameter by p Q = (o 0 ,G Q ). 

Now, let p = (o,G) be a generic point in R k x Q. Oefine 



ERLC 



Seir parametric Estimation 
11 



(8) FUlp) = / f(x|o,z)dG(z) 

R 

and 

(9) 6(p\p") - 6{(a l > G , ) > (a ,, ,G ,, J} 

■ I larctan o, 1 - arctan o 4 "l 
1 1 1 

+ / IG'UJ-G'Mzllexpl-lzDdz 
R 

Then, 6 is a metric in R k x Q. The completed space of R k x Q 
(R k x Q together with all the limits of its Cauchy sequences in the 
sense of the metric 6), will be denoted by R k x Q. 

Note that we have a well-known connection (BHHngsley, 1977) 
between weak convergence and the metric 6, given by the following 
lemma: 

LEMMA The weak convergence of distribution functions is metrlslzed 
by 

(10) d(F,G) » f I F(x)-G(x)|exp(-|x|)dx 

i.e., F n converges weakly to F iff d(F n ,F) + 0. 
Now we are ready for assumption 2. 
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Assumption 2 It is possible vo extend the definition of ?(x|p) so 
that the range of p will be R k x Q and so tnat for 
eny P lf p 2> ... and p* 1n R* x Q, p^ p* implies 
that T(xlPj) + ?(x|p*), almost sure T( x|p Q ) . 

First, the definition of f for (a,e) In R K x Q is completed by 
f(x|a,e) = 0 whenever 1 0 1 ■ « or if Ino^ = » (one or more of the 
o's are plus or minus «). Now, note that f is continuous in o. (for 
all i) and that f 1s bounded between 0 and 1. Furthermore, weak 
convergence of F n to F is equivalent with £ h(X n ) + E h(X) for all 
bounded measurable functions h (where E stands for expectation). 
But this means that (o-.G^ ♦ (o*,G*) implies T(x| p j ) + ?{x|p*). 

Assumption 3: For any p in R k x Q and any x > 0, w(x|p,x) is a 
measurable function of x, where w(x|p,x) = 
sup T(xlp'), the supremum taken over all p 1 in 
R k x Q for which 6(p,p l ) < x. 

Since ?(x|p) > 0 only for countable many values of x, w(x|p,x) 
can be replaced by g(x|p,x) whsre 

f w(x|p,x) when f(xlp) > 0 
(11) g(x|p,x) = I 

L 0 otherwise 

Now g(x|p,x) 1s obviously a measurable function of x (Wald, 1949). 
Let X be a chance variable with density T(x|p Q ); the operator E 
will always denote expectation under p n . 
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Assumption 4: For any g 1n R k x Q we have 

{w(Xl Pf x)} + 
(12) lim £ log [ ] <• 

This assumption 1s also called the integrability assumption . Since 
w(x| <2 for all x 9 it suffices to prove that 
E log[2/?(x|0g)] + < But this is immediately clear since X can 
only assume a finite number of values. 

The only assumption that needs to be verified is assumption 5, 
the identif lability assumption. This assumption does not hold for 
the Rasch model without additional conditions* 

Assumption 5: If &^ in R k x Q is different from 0 Q , then, for at 
least one y, 



y y 

(13) / TUIf^dn * / ?(x|p Q )dn 



Note that in our case \i is a counting measure, so that in fact 
the integral-sign is just a sum-sign, and even over a finite number 
of x's. Therefore, we can change the two "integration" pcfts. 
Hence, it is sufficient to prove that ?(x|o 0 ,G Q ) = TfxIo^G^) 
implies (oq.Gq) = (o^G^. So, from 



exp{x.(o. n -z)} exp{x (o. r z)} 

(14) / n dG (z) = / n li dGJz) 

R 1 1 + exp(o 1Q -z) R i 1 + exp{o n -z) 
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we want to conclude that o Q = and Gq = G^ where (14) holds for 

all (x x x k ) in {0,l} k . 

Recall that the Rascn model is unidentifiable and that therefore 
a constraint has to be given. A common one is J = 0. For our 
purposes it is easier to take the constraint = 0, since then 
(14) greatly simplifies. Now, let us rewrite and simplify (14). To 
save space, only the left hand slae of the formulas will be given, 
since the right hand side can then be written down easily with the 
obvious changes. , 



expJxJo^-z)} 

(15) / n dG (z) = 

R 1 1 + exp(o. 0 -z) 



expt-Jx.z) 

= exp(£x.0 io ) / R 1 ^nU) = 

1 1 10 R n {l+exp(o. 0 -z)} 0 

exp(-£x.z) 

= ex P ( f x i°iO ) / " 1 ~ dG Q (z) 
1 h(a 0 ,z) 

Now, let }>Xj = 1, or in words, one Item has been answered correctly 
and recall that o 1 = 0. Since (14) must hold for all x in {0,1} , 
we find for x^ - 1: 

exp(-z) exp(-z) 

(16) / dG Q (z) = / «.(z) 

h(a Q> z) U h(a r z) 1 



Q <8 
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and for Xj = 1 (all j t 1) 



exp(-z) 

(16a) expU n ) / dG n (z) = 

J0 h(a Q ,z) U 



exp(-z) 

= exp(aj 1 ) / dG^z) 

h(a^z) 

thus we now conclude that c^q = for all j»2,...,k. 

This holds for every pair of distribution functions Gq and Gj_. 
So, (15) can be simplified further; the factors in front of the 
integrals are equal, and the integrand is a function of the obser- 
vations only through £x.. Thus we have the following set of equa- 
1 1 



tions (for « 0,1 n): 



expf-^z) expt-^.z) 

(17) / j dG Q (z) = / 3 dG^z) , 

R n {l+expUj-z)} R n (l+expU-z)} 



where c^q - = all i). 

Substituting Jx^ = t, exp(-z) ■ u e (0,»), exptc^) - 5^ and 
dGj(z) = dHj(u) for j=l,2 we can rewrite (17) as 



(18) 



/ 

0 nd+^u) 



dH Q (u) 



0 ndn.u) 
1 1 



dH^u), t*0,l,...,n 
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We want to conclude Hq(z) = H^z) for all non negative z, where H 0 
and are both distribution functions on the nonnegatlve reals. 
Note that £^,...,5 n are fixed but unknown constants. 

Now 1t Is time to look at tne set Q of distribution functions G. 
We started by assuming almost nothing about this set Q : The 
distribution function had only had to have a finite second moment. 
But to solve (18) we must put more restrictions on Q. On the other 
hand, we can not put too many restrictions on Q since tnen we would 
overidentify the problem. An example for the latter would be to 
assume that G is a normal distribution. This would enable us to 
verify assumption 5, but then there may fce no connection to the 
"real world" anymore. One would like, however, Q to be a large 
class, containing many distributions of different forms (e.g., 
normal, x ♦ Polsson). 

On the other hand, there are only n independent equations in 
(18), so that one can not expect to find a solution if the prior 
distribution function has more than n "parameters". Since there are 
only n items, it is clear that we cannot hope to estimate a 
distribution function that has more than n "parameters" because we 
have for each person only n independent observations. 

If we take for Q the class of all discrete distribution function 
with at most m steps, then there are 2m-l free parameters (m knots 
and m-1 weights) and thus if we choose m=(n+l)/2 for n odd and 
m=(n+2)/2 for n even, then we may fulfill (18) in tho largest 
possible class. 

Note that (18) is a moment problem on the positive half line. 
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Karlin and Studden (1966) showed that if one restricts oneself to 

canonical distribution functions, the solutions to this problem are 

step functions: a lower and an upper principal representation. The 

lower principal representation is the interesting one, since the 

upper one places mass at Infinity. This lower principal solution 

has (n+l)/2 steps at different points for n odd and (n+2)/2 steps 

at different points with one point set equal to zero for n even. 

Since the functions v t = u t nd+^u)" 1 form a Tcneoycheff system 
1 1 1 

of Type II (v (u)/v,(u) ♦ 0 for t<s if u ♦ 0). This theory can be 



applied in this special case. For more details on this matter, see 
also the Leeuw and Verhelst (1986), who reached the same conclusion 
from a different starting point. 



So far this method has been called "new", what is so new then 
about this method? The strong relationship witn nonparametric ML 
has already been noted. The main difference is that 1n MML the Item 
parameters are estimated first and thereafter, using these 
estimates the prior distribution of the person parameters is 
estimated. The method in this paper shows that it is possiDle to 
estimate these two quantities together, and that one gets 
consistent estimates. 



Discussion 
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An Example 



Table 1 shows tne observed frequencies of response patterns to five 
dlchotomously scored items. The data consists of the responses on 
the subtest measurement of the IEA Second Mathematics Study 
(Pelgrum et al., 1983). 



For this data, the Andersen's Conditional Likelihood Ratio Test 
(Andersen, 1973) gave a chi-square of 3.271 with 4 degrees of 
freedom, so that the data fits the Rasch model pretty well. 

For the distribution of the anility, a step function with 3 
knots (values of £ at which the distribution function makes a jump) 
was chosen. The probability masses at these points are denoted by w. 

In table 2, the CML 1 ten; parameter estimates are given together 
with the estimates of the item parameters (o) and the estimates of 
the parameters of the distribution function, using the method in 
this paper. 



Insert Table 1 about here 



Insert Table 2 about here 
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Note that the item parameter estimates obtained by the new method 
are close to the CML item parameter estimates and that the 
distribution function is a step function with steps at different 
poi nts. 



?3 



Semi parametric Estimation 
20 



References 

Andersen, E.B. (1973) . Conditional inference and models for 
measuring , Copenhagen: Mental hyglenjnisk Forlag. 

Bllllngsley, P. (1977 ). Probability and measure . New York: Wiley. 

de Leeuw, J., & Verhelst, N. (1986). Maximum likelihood estimation 
in generalized Rasch models. Journal of Educational Statistics , 
11 9 183-196. 

Fischer, G.H. (1974). Einfuenrung in die Theorie psychologischer 
Tests: Grundlagen und Anwendungen. Bern: Hans Huber. 

Karlin, S., & Studden, W.J. (1966). Tchepycheff systems: With 
applications to analysis and statistics . New York: Wiley. 

Kiefer, J., A Wolfowltz, J. (1956). Consistency of the maximum 
likelihood estimator in the presence of infinitely many 
incidental parameters. Annals of Mathematical Statistics , 27 
887-903. 

Lord, F.M. (1983). Small N justifies Rasch model. In D. Weiss, 
(Ed.), New horizons in testing. New York: Academic Press. 

Neyman, J. & Scott, E.L. (1948). Consti stent estimates based on 
partially consistent observations. Econometrika , 16, 1-32. 

Pelgrum, W.J. Eggen, T.J.H.M., a Plomp, Tj. (1983). Tweede wiskunde 
project: Beschrijving van uitkomsten [Second mathematics 
project: Description of results]. Enschede, The Netherlands: 
Department of Education, University of Twente. 

Rasch, G. (1960). Propabillstic models for some intelligence and 
attainment tests. Copenhagen: Paedagogiske Institut. 



Semi parametric Estimation 
21 



Wald, A, (1948). Estimation of a parameter when the number of 
unknown parameters increases indefinitely with the number of 
observations. Annals of Mathematical Statistics , 19, 220-227* 

Wellner, J. A, (1985), Semlparametric models: Progress and problems . 
[CWI Newsletter, No. 9]. Amsterdam: Centrum voor Wiskunde en 
Inforraatica. 




?5 



Semi parametric Estimation 
22 



Table 1 

Observed Frequencies for the measurement data 



Response Response 

Pattern Frequency Pattern Frequency 



00000 


14 


10001 


3 


00010 


26 


10010 




00011 


3 


10011 


2 


00100 


4 


10110 


7 


00110 


11 


10111 


2 


01000 


10 


11000 


4 


01001 


2 


11010 


21 


01010 


62 


11011 


20 


01011 


22 


11100 


1 


01100 


3 


11101 


1 


01101 


2 


11110 


46 


omo 


28 


11111 


74 


01111 


18 
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Table 2 

Item and ability distribution estimates for the measurement data. 



CML a 5 w 



.849 .851 

-1.075 -1.079 

.745 .748 

-1.990 -1.995 

1.472 . 1.475 



-.253 .547 
-29.779 .024 
2.259 .429 
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